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1. Introduction. 

We define an AR(1) sequence as a solution of the equation 

X n = AAVi + rj n , 71 = 1,2,... (1) 

where {rj n } is a sequence of independent identically distributed random variables (innovation), Xq = x 
and A are nonrandom constants, 

< A < 1. 

The solution of ([I]) has the following representation for n = 1, 2, ... 

n— 1 

X n = A"x + ^A fc r/ n _ fc . (2) 

k=0 

In applications such as statistical surveillance [5] and many others it is of interest to know properties of 
the first passage time 

T a = infjre > : X n > a}, a > x, 
where we assume inf{0} = oo and so r a = oo on the set {sup <>0 X t < a}. Note that if 

Vn < H (3) 
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then in view of ([2]) for n = 1, 2, ... 



n-l 



X n < X n x + H^X k = X n (x 



1-A 



) + 



1-A 



fc=0 



and, hence, r a = oo when H / (1 — A) € (x, a). 

In applications, the distribution and expectation of such passage times are usually approximated via 
Monte-Carlo simulation or using Markov chain approximations (see e.g. (l6|). However, analytical bounds 
are also of interest (e.g. to control an accuracy of simulation algorithms). 

In this paper we describe some martingales related to AR(1) sequences in the case when the innovation 
{r] n } has a distribution with a light right tail (see Propositions 1 - 3 in Section 2). In Section 3 we use the 
martingale approach to show that if instead of ([3|) the following inequality holds 



then, under some mild assumptions on the left tail of rj l , the distribution of r a is exponentially bounded, 
see Theorem 1 in Section 3. In Theorem 3, Section 4, we prove a martingale identity (the analog of classical 
Wald's identity for random walks) and show how to use it to obtain bounds for Er a . 

The studies related to the first passage problem for AR(1) sequences are often employed in application 
fields such as surveillance analysis @K signal detection and many other areas. The martingale technique 
has already been used in [111 ] and [12| for deriving analytical approximations to the distribution and 
expectation of r a for discrete and continuous time AR(1) type processes, in particular, for the Ornstein- 
Uhlenbeck (O-U) processes in continuous time framework. In [13| a criterion on exponential boundedness 
of first passage time of O-U processes driven by general Levy processes is proposed. The papers [IH and 




[3j contain some analytical and numerical results on the distribution of first passage time of O-U type 
processes arising in engineering applications. A survey of some results in this area has been presented in 
lecture notes [151 ] . where, in particular, the explicit formula for the moment generating function of first 
passage time of AR(1) sequences with the exponentially distributed innovation was suggested. Although, 
the latter case is not discussed in the current paper, we would like to mention recent papers by Jacobsen 
and Jensen 0], Jacobsen 0] who have obtained more general results in the case when the innovation in 
AR (1) process is represented in terms of a mixture of exponential random variables; furthermore, in this 
case the distribution of the overshoot over a level by AR(1) process was obtained. 

The first passage problems for random walks and Levy processes were studied over decades. Major 
achievements in this direction have been obtained via the Wiener- Hopf factorisation in 0], [jjj and 

many other papers and monographs. An extension of the Wiener-Hopf factorisation technique to AR(1) 
sequences and O-U processes is yet to be found. 

2. Some martingales associated with AR(1) sequences. 

In this paper we always consider martingales with respect to the natural filtration T n = (j{XqX\, X n }. 
First, consider a martingale M n of the form 



where a deterministic function q v (y) depends on a parameter v , the variable y takes values from the domain 
D of X n . Note that, typically, D = (—00,00) but if, for example, condition ([3]) holds and H(l — A) > x 
then D C (-00, (1 - X)H). 
Under the assumption that M n has a finite expectation, by definition of martingales 



P{ Vl > a(l - A)} > 0, 



(4) 




M n = X vn q v (X n ) 



(5) 



E[M n \F n ^] = M n _i a.s. 



which with ([TJ) is equivalent to the equation 



\ vn E[q v (\X n ^ l +r ]n )\^ 1 ] = X^-^qviXn-!) a.s. 



Here r) n is independent of T n —\ and X n -\ may take any value from the domain D of X n . Therefore, if the 
function q v (y) is a solution of the equation 

Eq v (\y + r ll ) = \- v q v (y), y ED, (6) 

and the expectation Eq v (Xy + r/ n ) is finite then \ vn q v {X n ) is a martingale. 
Similar, if a martingale M n has the form 

M n = Q(X n ) - n (7) 
where Q{y) is a deterministic function, then we obtain another equation 

EQ(Xy + r ll ) = Q(y) + l, y E D. (8) 



Martingales of the form ([5]) and (J^J) have already been discussed in 11[ and 12J under the assumptions 

Ee UT] ^ < oo for < u < oo (9) 

and 

#M<oo (10) 

(though the corresponding equations ([6]) and (J8|) were not even mentioned in those papers). Here we will 
also use Q but will relax condition (|10p assuming only the existence of the logarithmic moment of iji (see 
Proposition 1 and 2 below) or moments of order 5 > (see Proposition 3). 
Denote the cumulant function of rj 1 as follows 

iP(u) = log£e m?1 , < u < oo. 

It is well known that if ip( u ) is finite then it is a convex differentiable function for u > (see e.g. Borovkov 
[2]), ^(0) = 0. In view of (|2]) we have for any u £ [0, oo) 

n-l 



Ee uX " = exp{A n x + ^ ^(A*u)}. 

fc=0 

n 

If Er} n = m is finite then '(/'('u) = mw + °( u ) as u — > 0. This fact implies that the partial sums ^ ip(\ k u) 

k=0 

converge to a finite limit, say, (j)(u) for any u > as n — > oo : 

n oo 

^v(AM^^(«)=E^ Afcu )- ( u ) 

fc=0 k=0 

Note that under assumption Q we may 

haveSs(?7^) 

= oo or, equivalently, ^'(0) = — oo. Under the latter 
condition there exists no > such that ip(u) < for u E (0,uo). It implies ?/>(A fc ii) < for all u G (0, no) 

oo 

and for all u > no and k > log(n/no)/ log(l/A). Therefore, the series ^ vp(\ k u) converges to a finite value 

k=0 

or diverges to — oo for all n > 0. We now show that this series converges under the Vervaat condition 

£71og(l + 1^1) <oo. (12) 



x = max(— x, 0), x + = max(x, 0) 
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Lemma 1. Let conditions (OJ) and hold. Then the function 



0(n) = £v(AM 



k=0 

is differentiable for u > 0, 



oo 

j u j - 1 1 1 1 -\ i . . i /.',-"• ^ . . i l/ ^.^0 /i.^ ^ \ ^ 

n— +oo 

fc=0 



lim log£e MX " = log£e M6 , 9 = VaV+i 



and 

= 0(Au) + , < u < oo. (13) 



Proof. Accordingly to the results of Vervaat [181 ] . under condition (fT2j) the process -X" n converges in 
distribution as n — > oo: 

x n ^> e , (14) 

where is a finite random variable. By ([2]) we obtain 

n-l 



fc=0 

and thus 



oo 

d 



e^AW (is) 



fc=0 

Since Efclo A Sfc+i = A Efcli A ^ 1? /fc+i + */i w e have 

+ (16) 

where in the right-hand side (RHS) random variables and n 1 are assumed to be independent. 
Replacing n k by n^, we obtain from (j!4H and (I15p as n — > infty 



fc=0 fc=0 

By the Lebesgue dominated convergence theorem this implies for any u > 

£e fc=0 — > fc=1 > 0. 

n— 1 n n 

Since ^ X k r] n _ k = ^ A fc r/ fc > — ^ ^ k Vk we obtain that 

fc=0 fc=l fc=l 

V>(A u) = lim inf logi^e fc=0 >log£e k =° > — oo 

n— >oo 

fc=0 
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and, hence, (fTTj) holds under condition (fT2j) . 

Thus, we have shown that for any u £ [0, oo) the function 



lim Ee uXn =logEe ue 

n^oo 



is finite. It is a differentiable function because it is a cumulant function of a finite random variable. 
Furthermore, in view (TTO|) (j){u) satisfies (fT3j) ,D 
If Eij n = m is finite then EQ = and as u — > 

<t>(u) = -^ + o(u). (17) 

As an illustrating example we consider the case of so-called spectrally negative stable AR(1) sequences 
with 

ip(u) = mu + Sgn(a — l)Cu a , < u < oo, 

where a S (0, 1) or a G (1,2], C > (note that C = Var(rj 1 )/2 in the case a = 2 which corresponds to 
Gaussian AR(1) sequences). One can verify that for this example 

0W = ^ + ^"'°_- A 1 i C "° ,O<u<oo. (18) 
We shall often use the following condition 

oUy-Hu) u v-i du < ( 19 ) 



with some real v (to be specified) and any y € D. 
A simple sufficient condition for validity of (fT9|) is 



lim = oo. (20) 

Note that for the case (|18p condition (|12p holds for all a > and condition (|19p holds when a € (1,2] but 
if a G (0, 1) it holds only for y < m. Also, note that if the innovation rj n is bounded from above then (|20p 
does not hold (see Lemma 3 below) but still condition (fT9|) could hold for y G D. 
Set 

/•oo 

N v (y)= / e uy -^ u) u v ~ l du. (21) 
Jo 

Proposition 1. Lei u > 0, conditions (0), < ti^|) and condition \19}) with v > ZioZd. T/ien 

A m A r „(A n ) is a martingale. (22) 

Proof. The function N v (y) is finite due the imposed conditions. Now we are going to verify that equation 
([6]) holds for q v (y) = N v (y). By Fubinni's theorem we have 

oo 

v-1. 



EN v (\y + rj 1 )= / exp{uAy + ip{u) - <j)(u)}u v L du 



o 



6 

(with use of ([15]) ) 

/*oo /*00 

/ e ^v-K^) u v-i du = x -v e uy ~^ u) u u - l du = X- v N v (y). 
Jo Jo 

Thus, we have shown that the function N v (y) is a solution of equation ([6]) and hence the process 
X m N v (X n ) is a martingale. □ 
Set 

1 r 00 

log(l/AJ 7 

Proposition 2. Let conditions (0|), flty) and with v = hold. Then 

H(X n ) — n is a martingale. (23) 
Proof. The function H{y) is finite due the imposed conditions. By Fubinni's theorem 

EH(Xy + m ) = — — - / ( e «^(«) - lle^W,- 1 *, (24) 

iog(i/A) y 

where the RHS is finite if for some no > 

/>oo 

/ |e uA ^ + ^ - lle-^n-^n < oo (25) 

and 

| e «Ay+^(«) _ i| e -*(«) u -ld u < oo. (26) 







The integral f^ 1 in (|25p is finite for any no > due (|19p with w = 0; the integral f Q Ua in (|26p is finite if 
and only if 

Mo 

|1 -e^ u) \u^du < oo. (27) 

o 

If -E 1 ^ = m is finite then in view of (|17p . obviously, condition (|27p holds. If Er]~ = oo then there exists 
no > such that 4>(u) < for n G [0, no]. This fact together with Lemma 1 lead to the following estimates 

/ \l-e^ u) \u- 1 du= / (l-e^ u) )u- l du = 
Jo Jo 

E (1 - e uri i)u~ l du < EI{ Vl < 0} / (1 - e'^u^du 
Jo Jo 



< P{-1 < ??! < 0} / (1 - e~ u )u- 1 du+ 



o 
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P{ni <-!}(/ (l-e-^u^du + EIfaK-l} u -1 du) 



< const + i^log^ + 1^7x1)- 

Thus, we have shown that integrals in (|25|) and (|26|) are finite and therefore the RHS of (|24|) can be now 
written (with use of (USD) as follows: 

roo I u\y-<f>(\u) _ uy-<f>(u)\ 

EH (Ay + Vn ) = H(y) + / * — — '-u^du. 

Jo log(l/A) 

To satisfy equation (jSJ) we need to show that the last integral equals to 1. In fact, this type of integrals is 
well known; it is called the Frullani's integral (see e.g. 0]). It equals really to 1 if it is absolutely convergent 
and the function <fi(u) is continuous (the latter is, of course, true). The absolute convergence can be checked 
similarly to the verifications of (125D and (|26l) as it had been done above. □ 

For the proof of Theorem 1 below we shall need also exponential martingales like ()22[) but with negative 
v < and a modified martingale function. 

Set 

/•oo 

W v (x):= ( e ux -^ u) - l)u v - l du. (28) 



o 



Proposition 3. Let conditions (GJ) and ^19jl with v < hold. If there exists 5 £ (0, 1] such that 

E(r]^) s < oo (29) 

then for v G (—5, 0) 

\ vn W v (X n ) is a martingale. 
Proof. First we note that applying for the random variable G from Lemma 1 the following inequality 

oo oo 

(X> fe |)'< J> fc [*, S€(0,1], 
k=0 k=0 

we obtain 



E\@\ s <J2^E\v k \ S = ^i. 



1 " A ° 

Hence, is finite under condition (|29[) . 

In view of (|19|) the function W v (x) is finite if there exists uq > such that 



"0 



|! _ e^y-^du < oo. (30) 



o 



If 5 = 1 (that is when Er\ n = m is finite) then in view of (|17p condition (|30p holds for any no > and any 
v S (—1,0]. If Erj~ = oo then EQ~ = oo and due to convexity of the function <fi(u) there exists uq > 



such that (j){u) < for u £ [0, uq\. This fact together with Lemma 1 leads to the following estimate 

/ 1 1 - e^ u) \u v ~ l du = E (1 - e^K^du 
Jo Jo 

i-u r-oo 

<E (1 - e~ u& )u v - l du < E(G-)~ V / (1 - e'^u^du. 
Jo Jo 

which is finite under condition (|29p for v € [—5,0]. 
Now by Fubinni's theorem we have 

/•oo 

EW v (Xy + rj n ) = / ( e «*»-*(A«) - l)^" 1 ^ 



o 



o 

and, hence, W v (x) satisfies the martingale equation 
3. Exponential boundedness of first passage times. 

Theorem 1. Let a > 0, conditions and A29\) with some 5 G (0,1) hold. Then there exists a > 
such that 

Ee aT « < oo. 

The main idea of the proof consists in use of a martingale X vn W v (X n ) with W v (y) from (|28p and the 
optional stopping theorem to derive the following bound for some v < and all n > 1 

£A" min ( T »' n ) < C < oo , (31) 

where C is a constant (not depending on n). The latter estimate along with Fatou's lemma implies Theorem 
1. 

To derive (|3ip . first we note that if we truncate the positive part of the innovation r\ n from above by a 
constant, say, N > then in ([2]) the corresponding stopping time r a will be greater than the original one 
(without truncation). So, it is sufficient to prove pip only for the truncated innovation. 

The derivation of (|3ip requires the following estimate for the corresponding cumulant function <p(u) 
associated with the truncated innovation {— rj~ + NI{n n > N}}. 

Lemma 3. Let condition U2\) hold, 



P{ m = N}= p=l- < 0} > 0. (32) 

Then as u — > oo 

W = +«(«)• 

Proof. We have 



ip(u) = log{Ee ur1 ^ )=uN- g{u) 



(33) 
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with 



Note 



g(u) = - log[EI{r] l < 0} exp{u(r/ 1 - N)} + p] > 0. 



y ! EI{r ]l < 0} exp{n(r ?1 - N)} + p 



In view of (1551) we have 



/V 

0(u) = ]>>(AM = ^ - A(u) , (34) 

fc=0 

where 

oo 

A(n) := > , < it < oo. 

fc=0 

The function A (it) is differentiable and concave since by Lemma 1 the function <j){u) is differentiable and 
convex. Obviously, 

A(it) = A(Au) + g(u) , < it < oo. (35) 

From concavity of A (it) it follows that the derivative A' (it) is non- increasing. It certainly has a lower 
bound (as A(u) > 0) and therefore there exists a finite limit 

lim A' (it) = A. 

Applying L'Hospitale's rule we have 

A (it) A(Xu) + g(u) ^ A g(u) 

A = lim — — = lim — — - — = XA+ lim ^- L . 

U— >oo u it— >oo y u^oo u 

As limu-^oo = hin^^oo </(it) = 0, we obtain that A = XA and therefore A = 0. 
Lemma 3 is proved. □ 

Proof of Theorem 1. Due to condition Q we can always chose N > a(l — X) > such that 

P{t ]i > N} > 0. 

Now let T a is the first passage time for AR(1) processes X n generated by the truncated innovation with 
the property (|32p and therefore the corresponding cumulant function has the property (|32|) . 
Note that 

N 

XnAr a = AI nA r a -l + Vn/\T a < Xa + N < - - 



1 n A r a = min(n, r a ) 
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Now one can check that conditions of Proposition 3 hold and so the process 
\~ vn W v (X n ) is a martingale. By the optional stopping theorem for any n > 1 

E(X^ nA ^W v (X nAT J) = W v (x) . 

Since X nATa < Xa + N and W v (x) is an increasing function of x we have for any v G (—5, 0) 

E{X v( - nAr ^W v {Xa + AO) > W v {x). (36) 

Note 

W v {x) = / («:«*-*(«) - Vju^du = C(x, v) + - (37) 



o 



where 



f'l poo 

C(x,v) = J (e ux ~^ u) -l)u v - 1 du + J , 



It is easy to check that C(x ;/ u) — > C(x,0) as v — > and C(x,0) is finite for any x < f^r. It implies that 
there exists u € (—5, 0) 

-2|C(s,0)| + - < < iy M (Aa + iV) < 2|C(Aa + TV, 0)| + - 

v v 

and thus with (|36p we obtain 

£?(A- mATa (l + 2v|C(Aa + iV,0)|) < 1 - 2v\C(x,0)\ . 

Now choose sufficiently small v < such that 1 + 2v\C(Xa + JV, 0) | > 0. Then this implies that for any 
n > 1 

} " l + 2,|C(Aa + iV,0)| < °°- 

The proof is completed. 
4. Bounds for the expectation of first passage times. 

Theorem 1 implies that E(r a ) is finite under conditions ([!]) and (j29f) . Actually, the latter condition can 
be slightly relaxed. 

Theorem 2. Let a > 0, conditions and ^ hold. Then 

E{T a ) < oo. 

Proof. We use Lemma 2 and the fact that the first passage time f a of AR(1) with a truncated innovation 
is greater than the original one (without truncation). 

As in the proof of Theorem 1 let Af > a(l — A) > such that P{r/i > N} > and let f a is the stopping 
stopping time for AR(1) processes generated by the innovation with the property 

P{f ll = N}= p=l- P{fn < 0} > 0. 

Then by Lemma 2 the corresponding cumulant function (f)(u) = + o(u) as u — > oo. 
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By Proposition 2 (or Theorem 2) 

Ef a An = - j— r / (£e uX -*" - e^e"^" V 1 ^ 
log(l/A) 7 

where Xf aAn < Aa + iV. It implies 

Ef a An < - 7 =— , / (e u ( Aa+Ar ) - e ux )e~ — {u)+o{u) u' 1 du = const < oo. 
log(l/A) J 

By Fatou's lemma it implies that Ef a < oo and thus the proof is completed. 

Now we prove a general martingale identity which can be used for derivation of bounds and asymptotics 
for E(r a ). 

Theorem 3. Let conditions U2\) and A19\) with v = hold. If E(r a ) < oo then 

1 f 00 

Er a = - , — / (Ee uX ^ - e^e'^u^du. 
log(l/A) J 

Proof. By Proposition 2 and the optional stopping theorem we have for any n = 1,2, ... 

£(r a A n) = EH(X TaAn ) - H(x) = - £ / (e u x — - e^Je-^^du . 

log(l/A) 7 

Since linin^oo i?(r n A n) = E(r a ) and 

oo 



EI{r a <n) (e uX - - e^Je^Wu-'dii 



o 



poo 

+ EI{r a > n) / (e uX " - e^e'^u^du , (38) 
Jo 

where the first term in RHS is a monotonic function of n. Therefore, we need only to show a convergence 
as n — * oo to zero for the latter integral term. Note that X n < a on the set {r a > n} and this implies the 
following upper bound 



poo 

EI{r a >n) (e 
J o 



oo 

ux n _ e ™\ e -4>(u) u -i du 



poo 

< P(r a > n) / (e ua - e ux )e-^ u) u^du -» 
Jo 



because P(r a > n) — > and the last integral is finite due to the imposed conditions. 

To show that the lower bound for the second integral term in the RHS of (|38p tends also to zero as 
n — > oo, we note 



;>oo 

£J(r a > n) / {e ux - e^e'^ u' 1 du < 
Jo 
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f'OO f'OO 

P(r a > n) / (e ux - ^e'^u^du + EI(r a > n) (1 
Jo Jo 

The first integral in the RHS converges, obviously, to zero. 
Note that in view of ([2]) 



e- uX -)e-^ u) u- l du. 



n-1 



X- < X n X~ + Y, ^Vn- k ■= Zn, n = 1, 2, . 



k=0 



where Z n is a AR(1) process with innovation sequence {r] k }, Zq = x . 
Since 

/ (1 -e'^^e-^u^du < / e-^ u) u- 1 du+ / (1 - e^ 2 ^^ u~ l du , 
Jo Ji Jo 

(where f^ 3 e~^ u ^ l u~ 1 du is finite by condition (|19p with v = 0), we need only to verify that 

lim £/(r a > n) / (1 - e^")^ 1 ^ = 0. 



Note 

EI(T a >n) [ (l-e- uZ ")u- 1 du = EI(T a >n) [ "(1 - e'^u^du 
Jo Jo 



< P(r a > n, Z n < 1) J (1 - e - ")^ 1 ^ + EI(r a > n, Z n > 1) J (1 - e~ u )Ti -1 du. 

The first term in the RHS here tends, obviously, to zero. For the second term we have 

fZ n +l 

EI(r a >n) J (1 - e- u )u~ l du < EI(r a > n) \og{Z n + 1). 

Since 

n n 

log(Z n + 1) < log(l +x~+J2vk)< lo g(! + x ~) + log ^ + ^* ) 

fe=l fc=l 

and by the Wald identity E( £ log(l + r^)) = £(log(l + rj^))Er a < oo, we obtain due to the Lebesgue 

fc=i 

dominated convergence theorem that as n — > oo 

El(r a > n) log(Z n + 1) < El(r a > n) log(Z Ta + 1)^0 

Now combining all estimates obtained above we complete the proof. 
Remark. Theorem 3 can be used for obtaining bounds and asymptotics of Er a . Since the overshoot 

ia = x r a ~a 
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is always nonnegative, under the assumption of Theorem 3 we obtain the following lower bound 

Er a > - j— - / {e ua - e^e^u" 1 *!. 



log(l/A) 7 

The upper bound can be obtained with use of truncation (if the original innovation is not bounded) of the 
innovation sequence {%} from above by a constant, say, H. For the latter case, noting thatX Ta < \a-\-H, 
we obtain that 

1 f 00 

Er a < Ef a < ; — TTTTT / (e< Aa+H ) - e^e^Wu" 1 *) 
log(l/A) J Q 

where the function <j>(u) is the corresponding cumulant of the limit distribution of the AR(1) sequence X n 
with the truncated innovation. 

To complete the exposition we just note that some applications of these bounds for finding optimal 
designs in statistical quality control have been presented in [171 ]. 
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